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Description 

PROJECTING SYSTEM WITH AN 
IMAGE-CAPTURING DEVICE 

Background of Invention 
[0001] i. Field of the Invention 

[0002] The present invention relates to a projecting system, and 
more specifically, to a projecting system with an image- 
capturing device for controlling a cursor. 

[0003] 2. Description of the Prior Art 

[0004] when a computer is connected to a projector to project an 
image onto a screen, a control device for controlling a 
cursor on the screen is required. Example control devices 
include a mouse, a trackball, and a joystick. Generally, a 
mouse has a roller ball, the rotation of the roller ball will 
be detected when the mouse slides over a surface to de- 
termine the distance and the direction of mouse move- 
ment so as to move the cursor. In order to use the roller 
ball on different surfaces, the initial position of the roller 



ball does not relate to any position on the screen. The us- 
age of the trackball is similar to the mouse; but the roller 
ball of the trackball is fixed to a fixed location, and the 
rotation of the roller ball of the trackball will be detected 
to determine the moving distance and the moving direc- 
tion of the cursor. In addition, a joystick is a rod type con- 
troller to control the movement for two coordinate axes. 
Although the physical moving direction of the joystick is 
corresponding to the movement of the cursor on the 
screen, it is not easy to control the joystick. The cursor on 
the screen may move in different speed when the joystick 
is positioned in different angles, so that the user is re- 
quired of a well-trained skill. 
[0005] Several remote control systems for a computer have been 
developed according to the requirements and favorites of 
users. As communication technology progresses, wireless 
communications, such as ultrasonic, infrared or radio fre- 
quency systems, establish a communication link between 
a remote controller and the computer allowing users to 
control the computer and the cursor in a more convenient 
manner. In a typical remote control system, a sensor is 
generally installed on the controller, the computer, or the 
screen to detect a relative position of the cursor. However, 



in practice, the length, the width, and the range of the 
space where the user is located will influence the control- 
ling of the cursor. For example, complicated and expen- 
sive systems are not appropriate in smaller spaces. 

[0006] Besides the computer screen, a large-sized display device 
such as a projector is also a video interactive tool. A sim- 
ple controller is required, for example, a controller is re- 
quired to turn over to another slide when displaying 
slides. In addition, for a presentation of a software intro- 
duction or training program, a simplified controller is pre- 
ferred to allow the user to control the cursor directly on 
the projecting screen. 

[0007] | n some projectors, a CCD is installed for detecting some 
special image on the projecting screen. For instance, when 
the user indicates a place on the screen with a laser light 
pen, a laser beam is reflected by the screen to the projec- 
tor and detected by the CCD. In such a manner, the pro- 
jector can move the cursor automatically to the place user 
indicated. It is very convenient for the user to move the 
cursor directly. However, when using a projector with a 
CCD, the laser beam will point to any place on the screen, 
and the projector is required to process more data. Addi- 
tionally, the laser is harmful to human eyes so the laser 



light pen has a safety problem. 
[0008] As mentioned above, when a computer is connected to a 
projector, a controller for moving the cursor of the com- 
puter is needed. Typical controllers such as a mouse, a 
trackball, or a joystick are less movable. A laser light pen 
is highly movable but harmful to eyes and has a safety 
problem. 
Summary of Invention 

[0009] it is therefore a primary objective of the present invention 
to provide a projecting system to solve the problems 
mentioned above. 

[0010] Briefly summarized, a projecting system for projecting an 
image onto a screen includes a projector, an image- 
capturing device, and a data processor. The projector in- 
cludes a light source, a beam splitter, a first image- 
forming device, a second image-forming device, and a 
prism. The beam splitter is installed on a side of the light 
source, and used for splitting a light beam generated by 
the light source into a visible beam and an invisible 
beam.The first image-forming device modulates the invis- 
ible beam to form a first image.The second image- 
forming device modulates the visible beam to form a sec- 
ond image which includes at least one cursor.The prism 



projects the first image and the second image onto the 
screen. The image-capturing device includes an output 
unit for outputting the first image captured by the image- 
capturing device.The output unit outputs a first part of 
the first image at a first time and outputs a second part of 
the first image at a second time.The data processor re- 
ceives data from the output unit and changes the position 
of the cursor according to the first part and the second 
part of the first image. 
[0011] These and other objectives of the present invention will no 
doubt become obvious to those of ordinary skill in the art 
after reading the following detailed description of the pre- 
ferred embodiment that is illustrated in the various fig- 
ures and drawings. 
Brief Description of Drawings 

[0012] pig.l illustrates a projecting system according to the 
present invention. 

[0013] pig. 2 illustrates the internal structure of the image- 
capturing device in Fig.l. 

[0014] pig. 3 illustrates another internal structure of the image- 
capturing device in Fig.l. 

[0015] Fig. 4 illustrates the internal structure of a projector ac- 
cording to the present invention. 



[0016] pig. 5 illustrates the direction and movement of the cursor. 
Detailed Description 

[0017] please refer to Fig.l showing a projecting system 10 ac- 
cording to the present invention, and Fig. 2 and Fig. 3 
showing the internal structure of an image-capturing de- 
vice 14 in Fig.l. As shown in Fig.l, the projecting system 
10 includes a projector 12, the image-capturing device 
14, and a data processor 16. The projector 12 is con- 
nected to the data processor 16 by a transmission line or 
wirelessly by ultrasonic, infrared, or radio frequency sig- 
nals. The data processor 16 may be a desktop computer, 
a notebook computer, or a personal digital assistance 
(PDA). The image proceeded by the data processor 16 can 
be projected to a screen 18. The image-capturing device 
14 is also connected to the data processor 16 by the 
transmission line or wirelessly, for controlling the move- 
ment of a cursor on the screen and the operation of the 
data processor 16. 

[0018] As for the image-capturing device 14, at least two possi- 
ble preferred embodiments are disclosed below. In the 
first embodiment, as shown in Fig. 2, the image-capturing 
device 14 includes a lens 20, a photo sensing device 22 



such as a CCD or a CMOS, and an output unit 24. The im- 
age-capturing device 14 continuously captures a first im- 
age (not shown)on the screen 18 with the lens 20. The 
first image is an invisible light and includes special pat- 
terns. The photo sensing device 22 converts these special 
patterns captured by the lens 20 into patterning data and 
transmits to the output unit 24. The output unit 24 then 
transmits the patterning data to the data processor 16. 
Therefore, The data processor 16 can control the move- 
ment of the cursor on the screen 18 according to these 
patterning data. 

[0019] | n the second embodiment, as shown in Fig. 3, the image- 
capturing device 14 further includes a processing unit 26 
and a data transmitter 28. The processing unit 26 is con- 
nected to the output unit 24, and the data transmitter 28 
is connected to the processing unit 26. The output unit 24 
transmits the patterning data continuously captured by 
the lens 20 to the processing unit 26 for calculation, and 
then the data transmitter 28 outputs the calculated result 
to the data processor 16. In other words, the lens 20 cap- 
tures a first part of the special pattern (the first image) at 
a first time Tl, and then captures a second part of the 
special pattern at a second time T2. Subsequently, the 



output unit 24 outputs patterning data of the first part 
and the second part of the first image to the processing 
unit 26, and the processing unit 26 calculates the direc- 
tion and movement of the cursor (not shown) on the 
screen 18 according to these patterning data captured at 
the first time Tl and the second time T2. The data trans- 
mitter 28 then transmits the movement data of the cursor 
to the data processor 16. Therefore, the data processor 
16 can control the cursor on the screen 18 without further 
calculation. 

[0020] please refer to Fig. 4 showing the internal structure of the 
projector 12. The projector 12 includes a light source 30, 
a beam splitter 32, a first image-forming device 34, a 
second image-forming device 36, a prism 38, and a lens 
40. The light source 30 of the projector 12 generates both 
visible and invisible light. The image projected on the 
screen 18 is the visible light, and the invisible light is al- 
ways not available in the prior projecting system. There- 
fore, the special patterns are formed by the invisible light 
is the present invention, no additional light source for the 
special pattern is required. 

[0021] The beam of the light source 30 is divided with the beam 
splitter 32 into visible and invisible beams. The visible 



beam is modulated by the second image-forming device 
36 to generate a second image including a cursor. The in- 
visible beam is modulated by the first image-forming de- 
vice 34 so as to generate the first image, that is the spe- 
cial pattern. Eventually, the modulated visible and invisible 
beams are converged by the prism 38 into a beam pro- 
jected through the lens 40 onto the screen 18. 

[0022] The first image-forming device 34 and the second image- 
forming device 36 can be liquid crystal display (LCD) pan- 
els or digital micromirror devices (DMD). The photo sens- 
ing device 22 of the image-capturing device 14 can detect 
the invisible beam. The special patterns formed by the 
first image include several different items. The image- 
capturing device 14 can capture the different items at dif- 
ferent time in order to calculate the direction and move- 
ment of the cursor. The following description takes a 
square pattern as an example of a pattern captured by the 
image-capturing device 14 to describe the calculation of 
the direction and movement of the cursor. 

[0023] please refer to Fig. 5 showing the direction and movement 
of the cursor. The beam splitter 32 divides the light of the 
light source 30 into visible and invisible beams. The visi- 
ble beam is modulated by the second image-forming de- 



vice 36 to generate an image on the screen 18, and the 
invisible beam is modulated by the first image-forming 
device 34 to generate the square pattern 51. The size of 
the squares can be determined by the capturing speed of 
the image-capturing device 14. The smaller the squares 
are, the more precise the cursor movement is, but the 
larger the calculation made by the data processor 16 
needs. 

[0024] | n this embodiment, the movement of the cursor does not 
relate to the real position of the squares on the screen 18, 
that is the movement of the cursor is calculated by a rela- 
tive moving distance and moving direction of the squares. 
The initial point of the movement is the position of the 
cursor on the screen 18 and the direction and the follow- 
ing movement are calculated according to two patterns 
captured consecutively by the image-capturing device 14. 
For instance, when the cursor is moving, the image- 
capturing device 14 captures different patterns at the first 
time Tl and the second time T2. As shown in Fig. 5, the 
solid lined part 50 is the first part of the first image cap- 
tured by the image-capturing device 14 at the first time 
Tl, and the broken lined part 51 is the second part of the 
first image captured by the image-capturing device 14 at 



the second time T2. By overlapping the first part and the 
second part of the first image, the vertical deviation dx 
and the horizontal deviation dy of the squares can be de- 
termined. Assume dx to be 8 pixels and dy to be 2 pixels, 
that means the cursor moves left 8 pixels and down 2 
pixels. 

[0025] As described above, the projector 12 utilizes the beam 
splitter 32 to split the beam of the light source 30 into 
visible and invisible beams. The visible beam is modulated 
by the second image-forming device 36 to generate an 
image, and the invisible beam is modulated by the first 
image-forming device 34 to generate the special pattern. 
The prism 38 then converges the two beams into a beam, 
which then projecting through the lens 40 onto the 
screen. Further, the image-capturing device 14 captures 
image on the screen. The photo sensing device 22 of the 
image-capturing device 14 receives the invisible beam, 
and patterning data of the special patterns formed by the 
invisible beam can be transmitted to the data processor 
16. The user can use the image-capturing device 14 to 
scan patterns on the screen 18 so as to determine the di- 
rection and movement of the cursor. 

[0026] | n the embodiment of the present invention, a simple 



2-dimensional square pattern is provided to determine 
the direction and movement of the cursor by detecting the 
deviation of the squares. Obviously, the use of a square 
pattern is only an example and another pattern may be 
substituted without departing from the spirit of the inven- 
tion. However, the method to capture different images are 
the same. First, the photo sensing device 22 captures a 
first image at the first time. When the image-capturing 
device 14 is moved, the photo sensing device 22 captures 
a second image at the second time. By comparing the two 
images, the direction and movement of the cursor can be 
determined. The comparison of the two images can be 
calculated by the data processor 16 as shown in the Fig. 2. 
In addition, referring to the Fig. 3, the comparison of the 
two images can be calculated by the processing unit 26. 
[0027] | n contrast to the prior art, the projecting system accord- 
ing to the present invention allows users to directly con- 
trol the cursor. The projector projects the invisible beam 
onto the screen to form the special patterns, and the 
photo sensing device detects the invisible beams. When 
the image-capturing device is moved, the data processor 
can control the movement of the cursor according to the 
difference of the patterns captured at different times. 



Conventional controllers such as a mouse, trackball, or 
joystick need to be operated at a fixed position. A laser 
light pen is highly movable but harmful to eyes. There- 
fore, the present invention provides a projecting system 
with advantages such as ease of operation, high movabil- 
ity, and high safety. 
[0028] Those skilled in the art will readily observe that numerous 
modifications and alterations of the device may be made 
while retaining the teachings of the invention. Accord- 
ingly, the above disclosure should be construed as limited 
only by the metes and bounds of the appended claims. 



